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A recent study of the effect of context in the judgment of contempt facial 
expression (Russell, 1991) was flawed by several confusions about what 
constitutes context. We argue that the context used should have ecological 
validity, through the use of many, rather than a few, facial expressions, which 
are spontaneous rather than posed, and which are judged by carefully selected 
judgment tasks, using clearly defined or well-understood emotional terms. The 
confusion in Russell’s work between accuracy studies and agreement studies 
is also addressed. 


We agree with Russell (1991) that “[t]he face is judged not in an 
absolute manner but relative to the context of judgment,” but we believe 
Russell’s method — in particular his use of still photographs — is not ap- 
propriate to the study of such complex phenomena. When we used still 
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photographs of facial expressions it was to answer simpler questions, such 
as whether people in different cultures will attach the same label to a given 
facial configuration. To examine how context influences the judgment of 
faces, which is Russell’s intent, we believe the face should be seen as it 
usually is, in motion, competing, as it typically does, with other sources of 
information such as the body, voice, and speech. Using such methods, we 
(Ekman, Friesen, O’Sullivan, & Scherer, 1980) showed that the relative im- 
portance of face, body, speech content, and vocal cues in impression 
formation depends upon the interpersonal context. Others who also utilized 
video or audiotape (viz, Berry, 1991; Bugental, 1986; Krauss, Apple, 
Morency, Wenzel, & Winton, 1981) obtained similar results. 

Even if one were to grant the utility of still photographs in studying 
the effects of context on judgment, we question the ecological validity 
(Brunswik, 1956) of how Russell is using such stimuli. Rather than exam- 
ining how facial expression judgments are influenced by the context of 
many other expressions which the observer sees, Russell examined the ef- 
fect of only one prior expression (what he calls the anchor) on one other 
photograph (the target). It is only with such minimal context that he is 
able to show the effect of context. When the context was multiple expres- 
sions (as in his Experiment 3), Russell obtained the same results we have 
reported. We suggest that our procedure — in which people see many ex- 
pressions, not just two — is more true-to-life than Russell’s procedure of 
showing just two expressions. 

A more adequate test of Russell’s ideas about contempt would show 
observers many different facial expressions, of many emotions, and within 
that context examine how different contempt expressions are judged de- 
pending upon what emotion is shown in the expression which immediately 
preceded each contempt expression. This paradigm was used by Matsumoto 
(1990), who had 42 observers view 99 photographs intended to depict 
different facial expressions. The observers used two judgment tasks: Thé 
first time they saw each expression they chose one emotion from a list 
of seven (anger, fear, disgust, contempt, surprise, sadness, happiness); the 
second time they saw the expressions they rated each picture on an in- 
tensity scale. Those data were collected and analyzed for a study of dis- 
play rules. 

To deal with the questions about context raised by Russell, we re- 
analyzed that data, focusing now on whether the emotion shown in the 
photographs which preceded contempt influenced the judgment of the con- 
tempt expressions. 

In this data set photographs intended to depict contempt were pre- 
ceded by photographs intended to depict anger three times, by disgust 
photos three times, by happiness photos three times, by fear photos twice, 
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Table I. 
Contempt photograph preceded by Percent judging contempt expression as 
photograph showing (anchor) contempt (target) 
Anger photo 1 Contempt photo 1 57.1 
Anger photo 2 Contempt photo 2 52.4 
Anger photo 3 Contempt photo 3 57.1 
Disgust photo 1 Contempt photo 4 59.5 
Disgust photo 2 Contempt photo 5 57.1 
Disgust photo 3 Contempt photo 6 76.2 
Fear photo 1 Contempt photo 7 66.7 
Fear photo 2 Contempt photo 8 57.1 
Happiness photo 1 Contempt photo 9 71.4 
Happiness photo 2 Contempt photo 10 66.7 
Happiness photo 3 Contempt photo 11 64.3 
Surprise photo Contempt photo 12. 57.1 


and by surprise once. As Table I shows, in every instance the modal judg- 
ment of the photograph intended to depict contempt was contempt. Thus, 
the proximal context (the facial expression shown in the immediately pre- 
ceding photograph) had no effect on the modal judgments of these pictures, 
regardless of what expression was shown in the preceding “anchor” 
photograph. 

We believe these results differ from what Russell reports because we 
have examined the issue more thoroughly. In our study, the photographs 
were seen in a more representative context (many expressions rather than 
two), so that the judgment of contempt was examined when many different 
emotions preceded it. The data in Table I, as well as our other research, 
differ from Russell’s experiments in another way which may also contribute 
to the difference in our findings. In our study, observers made categorical 
judgments prior to making any other evaluation of the expressions; in 
Russell’s Experiments 1 and 2, the categorical judgments were made after 
the observers made quantitative ratings of the same pictures. In recent 
work, O’Sullivan and Seyranian (1991) have shown that the order in which 
judgment tasks are performed influences the results obtained. 

They had 63 subjects rate facial expressions of emotion using two 
formats: (1) a free choice from seven affect terms and (2) an intensity rating 
of each of the seven affect terms. When subjects rated facial expressions 
with the free-choice format first, on average, 80% of them used only a 
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context, such as Russell, should investigate. 
Another aspect of context is the lexical abilities of the judges. Russell 


education is needed to understand the word “contemp 
English-speaking countries. If Russell believes education to be a factor in 


& 
a 
a 
2 
= 
fot) 
z 
& 
<= 
3 
E 
< 
2. 
T 
3 
3 
ay 
O 
£ 
te] 
Q 
— 
oc 
4 
jo} 
=) 
© 
z 
e 
o 
p 
3 
[e] 
mh 
[e] 
i} 
[e] 
| æ, a a w p e g = 


Ah eam 


> ; : a INAN A elt ERATE AES aes, 
EDS AS ih TT m RASA AS a nce A aA 
Tei Tne fatten Ra elt ante Tato cane ha des AT TC CPST 


eh we bp æ w% oe oe aË ae hk ee eee ae ae ak ae és 


Confusions About Context 173 


This point is related to the issue of our providing a definition of con- 
tempt in some of our studies. In literate cultures it has usually been our 
practice to have the observers read written instructions which explain the 
task (Ekman, et al., 1987). These instructions do not define the emotion 
terms, but simply list each emotion category with one word designations 
(anger, contempt, disgust, fear, etc.). Then we have asked whether there 
are any questions before we begin the experiment. The most frequent ques- 
tion in English-speaking groups has been about the meaning of contempt, 
although sometimes questions are asked about disgust. In response to such 
questions, we have defined contempt as “to feel morally superior, or better 
than another,” and disgust as “to feel repulsed by something or someone.” 
Note that we have not defined contempt or disgust by giving single word 
synonyms or related but different emotion terms, as did Izard and Haynes 
(1988). If we had done that, we would not have known which of the emo- 
tion terms the observers had in mind when judging a face. 

It is certainly fair to say, however, that some of the observers did 
have the definitions listed above in mind. It would be useful to know 
whether Russell would obtain the same results if he were to give those 
definitions to his observers. We would expect similar results, but with higher 
agreement, than with the one-word terms. In studying judgment context, 
data should be collected about the influence of observers’ having and not 
having definitions of each emotion term, or different definitions of each 
term. 

Question might also be raised about whether contempt is really dif- 
ferent in some way from other emotional states. Ekman and Friesen (1986) 
chose to study contempt precisely because they thought it was very different 
from other emotions — late in appearance developmentally, not reported 
in other primates, involving a moral judgment, and unilateral in its expres- 
sion. They had expected that there would not be cross-cultural agreement 
about the judgment of this expression, but there was. Perhaps contempt is 
less well defined, less salient in the English language because English- 
speaking countries are more individualistic, less communally oriented than 
other cultures. The fact that an emotion is not well-defined linguistically, 
however, does not necessarily mean, as Russell suggests, that it does not 
have a universal expression. The anthropologist Robert Levy (1984) re- 
ported that sadness was not linguistically identified in Tahitian, although 
Tahitians did show sad expressions and behavior in response to loss. Just 
because contempt is different from other emotions, it is imperative that 
students of judgment context not limit their studies to this one emotion. 
Could the same results be found with fear, anger, happiness, and sadness? 
More research is needed to answer this question. 
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Another aspect of context which is not adequately addressed in 
Russeil’s present and previous research (Russell & Fehr, 1987) is the place 
of such relativity research in the history of similar research endeavors. 
The work of Schlosberg (1952, 1954) and Abelson and Sermat (1962) is 
surely seminal in this area. The issue of why that earlier version of a rela- 
tivity approach to emotion judgments did not bear fruit should be con- 
sidered and not merely overlooked (perhaps causing us to reinvent a 
square wheel.) 

From our vantage point, Russell is not only mistaken in how to study 
context effects in the judgment of facial expression, but he has also con- 
fused the difference between an agreement and an accuracy study. In his 
first sentence, Russell says that he “began with the question of whether 
people are accurate [emphasis added] when they judge someone as feeling 
fear, anger or contempt. ...” At the end of the paper he acknowledges 
that he is not really studying accuracy and implies that it is next to impos- 
sible to do so. We agree he is not studying the question of whether the 
face provides accurate information, but instead is asking what factors in- 
fluence agreement among observers. While Russell’s question is important, 
we disagree with his statement that accuracy is not the best question to 
ask, and with the implication that it is a near impossible question to address 
because there is no way to know what the true emotion is. Russell takes 
this position, we believe, because he does not understand what an accuracy 
study requires. 

In their review of the literature on facial expression, Ekman, Friesen, 
and Ellsworth (1972) defined accuracy “to refer to ’correct’ information of 
some nature being obtained, by some means, from facial behavior” (p. 16). 
They described two very different means of obtaining information from the 
face: measuring facial behavior itself or asking observers to make judgments 
about the faces they see. The findings from these two methods may not 
always converge. Electromyographic measurement (EMG), for example, 
has found differences between depressed and nondepressed (Schwartz, 
Fair, Salt, Mandel, & Klerman, 1976) persons by measuring facial activity 
which is not visible to observers. Russell has used observers’ judgments, 
not facial measurement, to extract information, but he did not have any 
criteria to determine whether those judgments were correct. Such criteria 
could not be established with our photographs (which Russell has used), 
which were not made to study accuracy but agreement, and which, except- 
ing the happiness photographs, were produced by telling the posers what 
muscles to move. Russell’s (1991) claim that “. . . all we have today are 
various other judgments” fails to recognize the nature of the stimuli which 
he is using and is misleading in implying that accuracy cannot be studied. 
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When spontaneous facial expressions are studied, Ekman and his col- 
leagues described four different accuracy criteria which can be used to 
determine whether the information extracted from the face is correct: an- 
tecedent events, concomitant behavior, consequent events, and consensus 
by a panel of experts. They recommended utilizing more than one criterion 
and examining carefully situations where discrepancies among criteria oc- 
curred. There is considerable evidence that the face can provide accurate 
information about positive vs. negative emotions under some conditions, 
and about some, but far from all, the distinctions we and others believe 
can be made among positive and among negative emotions (cf. Matsumoto, 
Ekman & Fridlund, 1991; Fridlund, Ekman, & Oster, 1987), 

It is difficult, but not impossible, to perform accuracy studies. Many 
interesting questions remain about when the information provided by facial 
behavior is accurate and how precise such information may be. We would 
not claim that this is the “best” question to ask about facial expression or 
emotion, but it is certainly remains a timely and viable one, just as the 
question Russell has chosen to address — what influences observers’ agree- 
ment about the emotion shown in a face —is another worthy topic for 
investigation. 

In conclusion, let us note our agreement with Russell’s (1991) careful 
statement that the judgment of the emotion conveyed by a facial expression 
“. . . may depend on many subtle details of the context of that judg- 
ment . . .” We certainly hope he now does the research needed to find 
out how strong these effects may be, for which emotions, at what intensity, 
and whether these effects survive when facial expression is embedded 
within the context of other interpersonal behavior, not studied only as an 
isolated, statistic, posed representation in a still photograph. 
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